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Determining type of signal encoder 



FIELD OF THE INVENTION 

The invention relates to a method of deterrnining whether an encoded signal 
has been encoded with a particular type of encoder. The invention also relates to a server 
station being arranged to carry out such a method. 

BACKGROUND OF THE INVENTION 

Numerous types of encoding algorithms are nowadays used to encode 
multimedia files. Well known compression formats are "zip" (for data), «m P 3», «wma» (for 
audio) "avi" and "divx" (for movies). The respective encoder removes almost all 
redundancy, and in case of lossy encoding also the irrelevancy, from the original signal so as 
to obtain an encoded signal that can more efficiently be stored and/or distributed. 

Sometimes it is desired to determine by which type of encoder an encoded 
signal has been produced, or at least ascertain whether an encoded signal has been produced 
by a particular type of encoder. Computer file names have an extension (such as .zip, .m P 3, 
avi) for that purpose. Some encoders also render identification possible by adding a header 
that reveal the necessary information to the contents. However, file name extensions and 
headers are sometimes missing or cannot be trusted. 

Generally, the type of encoding cannot be identified by mere inspection of the 
encoded signal, because the encoded and compressed contents contains little or no structure. 
A trivial solution would be to try all possible decoders and interpret their outputs. For audio 
signals a human being would have to listen whether the decoder output is music or not. This 
may be hard decision for some types of music. Moreover, such a solution requires human 
interaction, and cannot be automated. 

OBJECT AND SUMMARY OF THE INVENTION 

It is an object of the invention to provide an alternative method and 
arrangement for determining whether an encoded signal has been encoded with a particular 
type of encoder. 
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These and other objeets are achieved with the method in aceordanee with the 
invention, whieh method comprises the steps of: reeeiving at lea* apart of said eneoded 
signal; decoding the received signal using a decoder which performs tire reverse operation of 
said particular type of encoder, deriving a fingerprint fiom the decoded signal; companng 
said fingerprint with fingerprints stored in a database; and concluding mat the encoded srgnal 
has been encoded with said particular type of encoder if the derived fingerprint corresponds 
to one of the fingerprints stored in the database. 

The invention exploits the insight that the structure of encoded material is 
meaningless to a decoder which is no. complementary to tire respective encoder. Contents 
being decoded by the wrong decoder differs significantly fiom the original contents. It is 
even unlikely *at music or video being reproduced byawrong decoder resembles any other 
existing original material. Fingerprints are binary sequences that identify robust perceptual 
features of contents. If two signals are similar, their respective fingerprints are also similar. If 
two signals are perceptually different, the respective fingerprints are also different. This 
property of fingerprints is used by the method in accordance wim me inventionto determine 
whether the decoded signal is an original one. 

An advantageous application of this method is promotion of a particular signal 
encoder In order to promote its «xxx» signal encoding algorithm, company X offers owners 
of its xxx-encoder the possibility to upload (parts of) their .xxx files to the company's 
website. Using the method acoording to the invention, the company's web-server checks 
whether the received file is indeed xxx-encoded material and in the affirmative case awards 
the owner. A possible award is the transmission, to the user, of metadata associated with the 
signal such as title, artist, lyrics, etc. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other aspects of the invention will be apparent from and elucidated 
with reference to the embodiment shown in the drawings, in which: 

Fig. 1 shows a schematic diagram of a system to illustrate the operation of the 

method in accordance with the invention. 

DESCRIPTION OF EMBODIMENTS 

The invention will be explained with reference to audio signals, but it will be 
appreciated that the invention is not limited thereto and can equally be applied to video and 
other type of multimedia signals. Fig. 1 shows a schematic diagram of a system to illustrate 
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the operation of the method in accordance with the invention. The system comprises a server 
1 and a client 2 connected together through a network 3. 

The client 2, which may in practice take the form of a personal computer, 
eomprises an audio encoder 21 and a return channel input unit 22. The audio encoder may be 
asoLeprogrambemgdownloadedfiomthe server l.Apiece of music 4 being apphed to 
the client is encoded by audio encoder 21. The encoded audio signal is subsequently 
unloaded to the server 1 through the network 

• „.Ai n 11a fineerorint extraction unit 12, a 

The server 1 comprises an audio decoder ll, a nngoit" 

processor 13, and a database 14. In the server, the music song being uploaded by me client is 

decoded by the audio decoder 11. If the encoder 21 being used by the client matches *e 

server's decoder 11, men the decoded signal will be the same as, or at least perceptually 

resemble, the original piece of music 4. Odrerwise, the decoded audio signal will be an 

meaningless * a decoder which has not been designed to be the complement of encoder 11. 

The decoded audio signal is applied to the fingerprint extraction unit 12. A 
fingerprint is abit pattern indicative of robust perceptual feamres of the audio signal. If two 
audio signals am perceptually very similar, the respective fingerprints are also smrdar (>ut ■ 
not necessarily identical). A practical embodiment of the fingerprint extractton unit 12 that 
can be used in the system is described in Jaap Haitsma, Ton Kalker and Job Oostveen, 
"Robust Audio Hashing for Content Identification", CBMI 2001, Brescia, Italy. For video 
applications, a practical embodiment is described in Job Oostveen, Ton Kalk* and Jaap 
Haitsma, "Visual Hashing of Digital Video: Applications and Techniques", SPIE, 
AppUcattons of Digital Image PmcessingXXIV, July 31 - Augusts 2001, San Diego, USA. 

The fingerprint extracted from the decoded audio signal is searched m the 
database 14 by the processor 13. In the database, one or more fingerprints are stored, that 
have previously been exttacted from respective original audio signals. If the extracted 
fingerprint matches one of the fingerprints stored in the database, then the decoder 11 has 
apparently indeed decoded an original piene of music. In that case, the processor concludes 
that encoder 21 of client 2 is indeed the counterpart of the server's decoder 11. An 
30 appropriate message is then sent to the client 

If the extracted fingerprint is not found in the database, then either the encoder 
21 being used by the client is not the counterpart of decoder 11, or the uploaded piece of 
music 4 is not stored in the server's database. In the latter case, the server may transmit a 
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message to the client requesting him to upload a particular song or one from a plurality of 
particular songs. 

In a practical embodiment of server 1, the decoding 11, fingerprint extraction 
12, and database searching are all performed by the processor 13, which to that end is loaded 

with an appropriate computer program. 

A novel application of this invention is promotion of a particular signal 
encoder. A company may encourage the public to buy its encoder by awarding the owner for 
uploading a piece of encoded material to its website. After identifying the origin of the 
uploaded signal as being encoded by the preferred encoder, the owner can be given rights to 
access particular information or execute particular processes. 

The invention can be summarzied as follows. In order to promote its "xxx" 
signal encoding algorithm, company X offers users of a particular encoder (21) the possibility 
to upload (parts of) their .xxx files to the company's website. The company's web-server (1) 
checks whether the received file is indeed xxx-encoded material by (i) decoding the file using 
an xxx-decoder (1 1), (ii) deriving a fingerprint (12) from the decoded signal, and (hi) 
awarding the owner if the derived fingerprint corresponds to one of the fingerprints stored in 
X's database (14). A possible award is the transmission, to the user, of metadata associated 
with the signal such as title, artist, lyrics, etc. 
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CLAIMS: 
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1. A method of determining whether an encoded signal (4) has been encoded 
with a particular type of encoder (21), comprising the steps of: 

- receiving at least a part of said encoded signal; 

- decoding (1 1) the received signal using a decoder which performs the reverse operation 
of said particular type of encoder; 

- deriving a fingerprint (12) from the decoded signal; 

- comparing (13) said fingerprint with fingerprints stored in a database (14); and 

- concluding that the encoded signal has been encoded with said particular type of encoder 
if the derived fingerprint corresponds to one of the fingerprints stored in the database. 

2. A method as claimed in claim 1, wherein said steps are performed by a server 
(1) which receives the encoded signal from a client (2) through a network (3). 

3. A method as claimed in claim 2, further comprising the step of awarding (22) 
the client if the server concluded that the received encoded signal has been encoded with said 
particular type of encoder. 



4. A method as claimed in claim 3, wherein said step of awarding comprises 
retrieving from the database metadata associated with the signal, and transmitting said 

20 metadata to the client. 

5. A server station (1) connected to a network (3) for receiving encoded signals 
from a client (2), the server station comprising: 

- a database (14) for storing one or more fingerprints identifying respective multimedia 
25 signals (4); 

- a decoder (1 1) for decoding an encoded signal received from said client, the decoder 
performing the reverse operation of a particular type of encoder (21); 

- means (12) for deriving a fingerprint from the decoded signal; 
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has bee, encoded with said particular type of encoder if the derived fingerprnt 
corresponds to one of the fingerprints stored in the database. 

< A server station as claimed in claim 5, farther comprising means for awarding 

tteclientif the server concludes mat the received encoded signal has been encoded with satd 
particular type of encoder. 

, A server station as claimed in claim 6, wherein said awarding comprises 

sieving from the database metadata associated with the signal, and hansmitring sard 
metadata to the client. 

8 . A computer program product for instructing a processor (13) to carry out me 

method as claimed in any of claims 1-4. 
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ABSTRACT: 



In order to promote its "xxx" signal encoding algorithm, company X offers 
users of a particular encoder (21) the possibility to upload (parts of) their .xxx files to the 
company's website. The company's web-server (1) checks whether the received file is indeed 
xxx-encoded material by (i) decoding the file using an xxx-decoder (1 1), (ii) deriving a 
fingerprint (12) from the decoded signal, and (iii) awarding the owner if the derived 
fingerprint corresponds to one of the fingerprints stored inX's database (14). A possible 
award is the transmission, to the user, of metadata associated with the signal such as title, 
artist, lyrics, etc. 
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Fig. 1 
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